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ADAPTIVE BLOCK IMAGE COMPRESSION 
Field of the Invention 

5 The present invention is related to processes and apparatus for processing image data, 

including combinations of text, graphics, and other images. More particularly, the present 
invention is related to techniques for reducing buffer memory requirements for such processes 
and apparatus. 

10 Background of the Invention 

Most computer systems use a form of raster image to output image data to a visual 
output device such as a cathode ray tube (CRT) monitor, liquid crystal display (LCD), or a 
printer such as a color laser copier. A raster image is represented as a series of scan lines of 
pixels, wherein each pixel is accessed in a sequential manner, and each scan line is processed. 

1 5 An area to which image data may be output sequentially by the visual output device is referred to 
as a page. The image data of a page provides its complete visual representation. 

Interpreters of page description languages typically process images in one or both of 
two modes: band mode and frame mode. In band mode, the entire page description is read, and 
a list of every imaging operation, called a display list, is built including all the data needed to 

20 image the page. Since all of the data also may include very large scanned images, a display list 
can grow to be very large. Scanned images require that the display list be temporality stored on 
secondary storage, with a performance reducing step required both to read and write. A 
fundamental advantage, however, is that the output frame is only traversed once, which permits 
lower speed devices to be connected with a minimum of buffering. 

25 Frame mode on the other hand, does not include constructing a display list. Instead, a 

full image exists, and as each imaging operation is encountered, it is immediately processed to 
update the full page image. Scanned images are also processed immediately, eliminating the 
problem of temporarily storing them. Thus, whereas band mode traverses the output page image 
in an orderly fashion, sweeping from one edge to the opposite edge, frame mode accesses the 

30 output page randomly. 

Both of these however generally require a buffer memory which can hold the entire 
visual representation of a page. This memory is referred to as a frame buffer. Because of the 
large memory requirements for representation of a page, particularly with color laser copiers and 
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color images, it is desirable to reduce the buffer memory requirements, for example by using 
some form of compression. 

One compression method is shown in U.S. Patent No. 5,506,944 to Ronald S. Gentile. 
This reference shows a system in which an image is divided into several regions. A page 

5 description, describing objects to be placed on the page, is ordered so that commands for each 
region are processed together. The regions are processed sequentially. A single memory 
element capable of storing the image data of an entire region in an uncompressed form is 
provided. After each region is processed, its corresponding image data is stored in a stack (a 
last-in, first-out buffer) in compressed format. When a page has been completely processed, this 

1 0 compressed image data is then read out of the stack to be decompressed and output to a printer. 
A problem with this system however is that it requires a page description to be 
completely processed or ordered before processing of the frames can begin. It does not display 
operations to be processed in an arbitrary order. Additionally, it may suffer from the same 
problems as band mode operation when the display list becomes too large. 

15 

Summary of the Invention 

In the present invention, a page of an image is divided into several regions. Each of 
these regions may be compressed according to a different technique according to the kind of data 
within the region. In the proffered embodiment, the regions are fixed in equal sizes in an NxM 
20 matrix, but they need not be for purposes of the invention. Data for each region is available at 
any time and can be randomly accessed. Display operations may be processed in any order. For 
each display operation, the region which is affected, is uncompressed and processed. As other 
regions are processed, memory space is made available by compressing data in currently unused 
regions. 

25 By using this kind of representation of a page and method of processing display 

operations, each region can be represented independently and differently. Each region can be 
compressed with a method that works well for the data contained in that region. Compression is 
used to reduce the memory requirements. Because display operations can be processed in any 
order, regions may be processed by multiple imaging systems functioning in parallel. 

30 Additionally, representations of regions on a page can be stored, transmitted, or used in different 
locations at different times. 
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Accordingly, one aspect of the present invention is a computer system and computer- 
implemented process for generating a representation of a document image. A representation of a 
document is generated, wherein the representation includes an indication of a plurality of regions 
into which the document is divided, compressed image data for each region and an index 

5 indicating a storage location of the compressed image data for each region. Indications of 
operations for generating the document image are received. For each operation, the 
representation of the document image is processed so as to add image data to the representation. 
Such processing involves identifying each region affected by addition of image data according to 
the indicated operation, decompressing the compressed image data of the identified region, and 

10 modifying the decompressed image data according to the indicated operation. 

Another aspect of the invention is a digital nonvolatile computer-readable data 
recording medium for storing a representation of a page of a document comprised of a plurality 
of regions. The representation defines a list of region descriptions on the nonvolatile computer- 
readable data recording medium, wherein each region description includes an indication of a 

15 compression mode used to generate the compressed image data of the region, and an address 
indicating a storage location of the compressed data. For each region, compressed image data is 
defined at the storage location on the nonvolatile computer-readable data recording medium. 

Brief Description of the Drawing 

20 For a better understanding of the present invention, reference is made to the 

accompanying drawings, where are incorporated herein by reference and in which: 

Fig. 1 is a block diagram of an example computer system which may be used for 
implementing the present invention; 

Fig. 2 is a block diagram illustrating a typical memory system for use in the computer 
25 system in Fig. 1 ; 

Fig. 3 is a diagram illustrating a page of image data divided into several regions; 
Fig. 4 is a diagram illustrating a data structure for representing a virtual frame buffer 
divided into several regions; 

Figs. 5a-5g are diagrams illustrating example formats for representing run coded data; 
30 Fig. 6 is a data flow diagram of one embodiment of the present invention; 

Fig. 7 is a flowchart describing operation of the virtual frame buffer manager 136 in 

Fig. 6; 
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Fig. 8 is a more detailed block diagram of one embodiment of the output device 144 in 

Fig. 6; 

Fig. 9 is a flowchart describing operation of the circuit described by Fig. 8. 

Detailed Description 

The present invention will be more completely understood through the following 
detailed description which should be read in conjunction with the attached drawing in which 
similar reference numbers indicate similar structures. 

The present invention may be implemented using a digital computer. A typical 
computer system 20 is shown in Fig. 1 , and includes a processor 22 connected to a memory 
system 24 via an interconnection mechanism 26. The interconnection mechanism is typically a 
combination of one or more buses and one or more switches. An input device 28 is also 
connected to the processor and memory system via the interconnection mechanism, as is an 
output device 30. 

It should be understood that one or more output devices may be connected to the 
computer system. Example output devices include a cathode ray tube (CRT) display, liquid 
crystal display (LCD), printers including color laser copiers, communication devices, such as a 
modem, and audio output. It should also be understood that one or more input devices 28 may 
be connected to the computer system. Example input devices include a keyboard, keypad, 
trackball, mouse, pen and tablet, communication device, audio input and image scanner. It 
should be understood that the invention is not limited to the particular input or output devices 
used in combination with the computer system or to those described herein. The input and 
output devices may be included within or external to a main unit which typically houses the 
processor 22, memory system 24 and interconnection mechanism 26. 

The computer system 20 may be a general purpose computer system, which is 
programmable using a high level computer programming language, such as "C++" The 
computer system may also be implemented using specially programmed, special purpose 
hardware. In a general purpose computer system, the processor is typically a commercially 
available processor, such as the Pentium microprocessor from Intel Corporation. Many other 
processors are also available. Such a processor executes a program called an operating system, 
such as the Windows operating system from Microsoft Corporation, which controls the execution 
of other computer programs and provides scheduling, debugging, input-output control. 
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accounting compilation, storage assignment, data management, memory management, and 
communication control and related services. The processor and operating system define a 
computer platform for which application programs in high level programming languages are 
written. It should be understood that the invention is not limited to a particular computer 
5 platform, particular operating system, particular processor, or particular high level programming 
language. Additionally, the computer system 20 may be a multi-processor computer system or 
may include multiple computers connected over a computer network. 

An example memory system 24 will now be described in more detail in connection with 
Fig. 2. A memory system typically includes a computer readable and writable non-volatile 

10 recording medium 40, of which a magnetic disk, a flash memory, and tape are examples. The 
disk may be removable, known as a floppy disk, and/or permanent, known as a hard drive. The 
disk, which is shown in Fig. 2, has a number of tracks, as indicated at 42, in which signals are 
stored, in binary form, i.e., a form interpreted as a sequence of 1 's and O's, as shown at 44. Such 
signals may define an application program to be executed by the microprocessor, or information 

1 5 stored on the disk to be processed by the application program, such as video information stored 
in a data file. Typically, in operation, the processor 22 causes data to be read from the non- 
volatile recording medium 40 into an integrated circuit memory element 46, which is typically a 
volatile random access memory, such as a dynamic random access memory (DRAM) or static 
memory (SRAM). The integrated circuit memory element 46 allows for faster access to the 

20 information by the processor and disk 40, and is typically called the system memory. The 

processor generally causes the data to be manipulated within the integrated circuit memory 46 
and copies the data to the disk 40 if modified, when processing is completed. A variety of 
mechanisms are known for managing data movement between the disk 40 and the integrated 
circuit memory 46, and the invention is not limited thereto. It should also be understood that the 

25 invention is not limited to a particular memory system. 

The present invention provides a system for representing images such as shown in Fig. 
3. Fig. 3 shows a page of image data from a raster image. Each page 50 is broken into an array 
of regions 52. There are a plurality of regions horizontally as indicated at 54 and vertically as 
indicated at 56. In one embodiment of the invention, each region is 128 x 128 pixels. For a 

30 typical sheet of SY 2 x 1 1 paper, using a typical resolution for a color laser copier, there are 

roughly 37 regions horizontally, each of which is 128 pixels wide. Each region may contain one 
or more image objects which may include lines 58, detailed images 60, text 62 or other objects 
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64. The image objects and their location on the page are typically represented using a page 
description language such as PostScript (a trademark of Adobe Systems, Inc.). 

In the present invention, each region of the page is separately addressed and is 
independent of the neighboring regions. Accordingly, each region can be represented 

5 independently and differently. Fig. 4 shows a representation of the image in one embodiment of 
the invention. In this embodiment of the invention, a page of data is represented by an N x M 
matrix, where N is the number of regions in each row in the image, and M is the number of rows 
of regions in the page. The representation shown in Fig. 4 can be implemented as a linked list of 
region descriptors 70 and row descriptors 72. In particular, each region descriptor 70 includes a 

10 description 74 indicating a kind of compression or encoding used for this region, and an address 
76 indicating the location of the actual image data (which may be encoded, compressed, or 
uncompressed) in computer memory. Each row 78 includes a list of region descriptors 70, 
followed by a row descriptor 72. In a row descriptor 72, the description 80 includes a link to the 
next row, e.g., row 2, and an indication of whether this is the last row, such as shown at 82. 

15 By using such a representation of an image, each region may be compressed with a 

compression method that is different from the compression method of other regions. Thus, each 
region can be compressed with a method that works well for the data contained in that region. 
Additionally, some regions can be compressed, while other regions can be maintained 
uncompressed. Similarly, some regions can be compressed with methods that introduce loss 

20 while other regions can be compressed using a technique that is not lossy. 

Some suitable compression formats will now be described in connection with Figs. 
5a-5g. All of these methods use a form of run length encoding. Referring now to Fig. 5a, each 
data word of coded data includes a two bit identifier 90, indicating the type of compression and a 
count 92, followed by a value 94. In Fig. 5a, the indicated code identifies a format in which N + 

25 1 pixels of the value indicated by field 94 are emitted upon decoding. The value N is defined by 
the 6 bit value in the field 92. 

Some compression is provided by the formats shown in Figs. 5b-5d. In Fig. 5b, the 
compression code 96 is followed by a value N as indicated at 98, then followed by N + 1 values 
100. This format indicates that the N + 1 values following the instruction word 96, 98 are to be 

30 emitted upon decoding. Similarly, in Fig. 5c, the compression code 102 indicates that a number 
N of values follow, as indicated at 104. This compression code is somewhat lossy because each 
of these values is to be emitted twice upon decoding. In particular, if the first value is "00," it is 
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emitted twice, i.e., to produce "0000" before the next value is then emitted twice. Similarly, as 
shown in Fig. 5d, the compression code 108 indicates that a number N as indicated at 110 of 
values 1 12 are to be emitted sequentially in triplicate upon decoding. 

Bit mode compression formats are also provided as shown in Figs. 5e-5g. A 1 bit mode 
5 compression format is shown in Fig. 5e. A bit mode is indicated by the first 4 bits of the 

instruction code as indicated at 114. The last 4 bits of the instruction code as indicated at 116 
indicates a 1 bit mode compression format in Fig. 5e. In this format, for each of the 16 bytes 1 1 5 
that follow the instruction code, a byte representing 0x00 is emitted for each 0 bit and a byte 
representing OxFF is emitted for each 1 bit. Similarly, in 2 bit mode as shown in Fig. 5f, which 
10 is indicated by an instruction code as indicated at 118, every 2 bits indicates a particular byte 
value to be output. In 4 bit mode, as indicated at 120 in the instruction code of Fig. 5g, every 4 
bits is used to determine an output byte. There are many other compressions methods which may 
be used in the present invention, of which some are discussed in more detail below. For 
example, in Fig. 4, by using a unique code as a region address 76, a simple way for representing 
15 the region as being entirely white or entirely black is obtained. This can represent the fact that 
no image data exists for that region. 

The processing of a page description to produce a representation such as shown in Fig. 4, 
will now be described in connection with Figs. 6 and 7. A page description 130 is typically 
provided in a page description language such as PostScript. An interpreter 132 receives the page 
20 description 130 and processes it according to the definition of the page description language. For 
example, the PostScript language can be used which is well-known in the an. There are 
commercially-available interpreters for this language and it is possible to build an interpreter 
given the language definition. The interpreter 132 outputs, for each command in the page 
description language, image information such as color for each pixel affected by the operation, as 
25 indicated at 134. This information 1 34 indicates a location in a page and the image information, 
e.g., color, to which it should be set. This information is utilized by a virtual frame buffer 
manager 136 to modify and maintain a list structure 138 such as described above in connection 
with Fig. 4. In particular, the virtual frame buffer manager 136 maintains an image memory area 
to which the addresses 76 (Fig. 4) refer for each region. This image memory area is illustrated at 
30 140 in Fig. 6 and is typically located in the memory system 24 in the computer system 20. The 
virtual frame buffer manager 140 writes pixel and color information into appropriate locations in 
the image memory area and compresses and decompresses data for regions in that area in 
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accordance with space available in the image memory area. Preferably, the image memory area 
is smaller than a frame buffer that would be required to hold uncompressed data for the entire 
page. Using the virtual frame buffer manager 1 36, regions that are not being used by the 
imaging system at any particular time can be maintained compressed, while regions that are 

5 being used can be uncompressed for efficiency and ease of access. There is no requirement that 
the storage kind or size used to store the regions to be uniform. Thus, memory or disk could be 
used, as well as other storage means. 

A flow chart of the operation of the virtual frame buffer manager 1 36 will now be 
described in more detail in connection with Fig. 7. The pixel data is received in step 1 50. The 

10 virtual frame buffer manager 136 then determines what region contains this pixel in step 152. 
This is done by using a mapping between the number of pixels per line and lines per region, to 
the number of regions per row and number of rows per page. Next, the virtual frame buffer 
manager determines whether the region data is compressed and also determines the location of 
the data in step 154. This is done by examining the list structure 138. Next, conditional 

1 5 decompression takes place. Thus, if the region data is compressed, it is accessed and 

decompressed in step 156 and placed into the image memory area 150. The list structure 138 is 
updated to the new location and to indicate that the data is now uncompressed. If sufficient free 
memory space is not available in the image memory area 150, an uncompressed region is located 
and is then compressed to make space available. Selection of an uncompressed region may be 

20 performed by examining the list structure 138 such as shown in Fig. 4, and the list structure is 
updated when the data is compressed with the new compression type and its new location. The 
location of the region data is then located in step 1 58 once uncompressed data is available. This 
uncompressed data is then updated in step 160 according to the received pixel data. The next 
pixel data can then be received by returning to step 150. 

25 In the process described in Fig. 7, compressed data for all image regions are stored in 

the image memory area 140. However, there is no requirement for the storage used for the 
regions to be uniform. For example, some regions may be held in random access memory, others 
on a disk, and others on a network accessible server. Compressed representations of a page can 
be stored on secondary storage, transmitted through a network, or in other ways moved in space 

30 or time to be printed in a different location or to be processed at a later time. In particular, the 
list structure 138 and compressed and uncompressed region data may be combined and stored on 
a disk, such as indicated at 142, for later use. In such a case, the linked list of representation such 
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as shown in Fig. 4, can be a simple array stored at the beginning of a file, wherein the region 
address 76 indicates the offset of the data within the data file. Such data representations can then 
be stored for later use or transmitted in a network for example. In particular, a representation of 
a region may be stored and later copied into a data file. A list structure 1 38 may also be 
5 initialized by reading such a data file. The list structure 138 may also be output to an output 

device 144. One embodiment of an output device will now be described in connection with Figs. 
8 and 9. 

The representation of a page as provided by such a list structure 138, an embodiment of 
which is shown in Fig. 4, permits a circuit receiving such a list structure to construct a stream of 

10 output pixels in real-time. That is, the regions descriptions can be processed as if they arc 
computer instructions to which the hardware is responsive to generate the image data. 

More particularly, the image to be decompressed and output is represented in the main 
memory of the computer as a list of rows and regions. Each row of regions contains as many 
region descriptions as there are regions across the page, as well as the memory location of the 

15 next row. Each region description includes the memory location of data for the region and the 
form of compression used for that region. Each region description can then be used as an 
instruction to the output device that indicates the location of the data and the operation to be 
performed on the data. 

One embodiment of the output device 144 which provides scan line data to visual 

20 output, such as a color laser copier, is shown in Fig. 8. This circuit includes an interface 170 
which connects the output device to the interconnection mechanism 26 of the computer system 
20. For example, if the interconnection mechanism is a PCI bus, as indicated at 1 72, a PCI bus 
interface 174 may be used, such as the AMCC 5933 PCI bus interface. Data is read from the list 
structure 138 through the PCI interface 170 to the remainder of the circuit. An optional FIFO 

25 176 may be used to decouple operation of the circuit synchronization with data transfer over the 
PCI bus interface 170. The data is read into the FIFO 1 78 which temporarily stores data from the 
list structure and image data to be processed. A status register 180 processes tags assigned to the 
data as the data is placed into the FIFO 1 78 in a manner to be described below. A register 1 82 is 
used to read the data from the FIFO 178 and decipher commands and data to be placed into a 

30 register 1 84 and 1 86. The data in the data register is processed according to the command in the 
command register 1 84 and output to the pixel scan line FIFO as shown at 1 88. This FIFO is 
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accessed by an engine video interface 190 which reads data at rates determined by a visual output 
device, such as a color laser copier. 

The operation of this circuit will now be described in more detail in connection with 
Fig. 9. The FIFO 178 is used as a variable capacity buffer. Each word in the FIFO 178 contains 

5 32 bits of data, plus a tag indicating what type of data it is. The types of data include a region 
type or description, 4 bytes of buffer data, 3 bytes of buffer data, 2 bytes of buffer data, 1 byte of 
buffer data, or a region address. The FIFO is loaded initially with a list of two word descriptions 
of each region in the row about to be processed, as indicated at 200 in Fig. 9. The first word of 
each description is tagged as a region type, and indicates how the region is compressed. The 

10 second word of each description is tagged as the region address, and indicates where the data for 
the region can be found. The data is then read from the FIFO by the register 182. A variety of 
actions are taken depending on what type of data is found. Region addresses are fed to the 
memory channel to read sequences of words of region data. Enough data is read from a region 
for one scan line in step 202. Region data is consumed by processing of the descriptions 

15 components and is either stored in the FIFO or not after processing, depending on the 
decompression mode. 

In particular, the data for a region for one scan line is placed in the FIFO 178 after the 
region type and region address are placed back into the FIFO first. Because the buffer 1 78 is a 
FIFO, each region description in a row will be accessed first, placed back in the FIFO followed 

20 by enough data for one scan line for that region. The data placed in the FIFO 1 78 is tagged as a 
type of buffer data. When the row description at the end of the list of region descriptions is read 
from the FIFO 1 78, the region descriptions are then processed with the data that follows. Each 
pixel is then generated according to the type of region in step 204. If there is any unused data 
when the end of the region in the scan line is achieved, the remaining data is placed back into the 

25 end of the FIFO and the next region is selected in step 206. In particular, in some compression 
modes pixel data is then generated according to the type of the next region as indicated at 204. 
When the end of the line is reached, enough data for each region for the next scan line is then 
read in step 202. The steps 204 through 206 repeat until the last scan line of this row of regions 
is reached as indicated at 208. When the last line of the row is processed, the list structure for the 

30 next row of regions is then read in step 200 and the process repeats for steps 200 through 208 for 
the next row. The last row of a page is detected by the end of row description 82 followed by a 
NULL address as shown in Fig. 4. 
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Using the circuits and process described in Figs. 8 and 9 to process a list structure as 
shown in Fig. 4 provides a simple and cost effective way to buffer data representing the region 
descriptions as well as the actual data for the regions during the generation of output image data. 

Dynamically changing the representations between compressed and uncompressed 
5 formats is similar to a virtual memory system. Some of the traditional problems associated with 
virtual memory are expected. For example, if a page description requires imaging into every 
region repeatedly, a significant amount of time will be required to manage the representations. 

To solve these problems of virtual memory in one embodiment of the invention the 
imaging system begins operation in a band mode. As each imaging operation is encountered, it 
10 is added to a display list by the interpreter 1 32. Under certain conditions, the display list is 
processed, just as if the imaging system were operating in band mode. For system efficiency, 
scanned images are processed as if the imaging system is operating in a frame mode, eliminating 
the need to temporarily store the image data. One condition is the occurrence of a scanned image 
in the page description. In such a case, the display list is processed immediately in band mode, 
15 and the imaging system converts to frame mode. After completing the scanned image, imaging 
again returns to band mode. 

Another condition occurs when a sufficient number of imaging operations have been 
recorded. In such a case, the display list is executed to limit the amount of memory required for 
the display list, and to be able to print very shortly after a request for display is encountered, and 
20 to allow the display list to reside completely in physical memory without being swapped to 

virtual memory. When completely processed, the display list is discarded, and a new display list 
is started. 

An incidental benefit of this embodiment relates to clipping, or using constructs in to 
the page description language limit the portion of the page that will be colored by any imaging 
25 operation. In frame mode, the description of the clipped region must be processed for each 
imaging operation. In band mode, the description is processed only once, and each imaging 
operation, in turn, is clipped against each scan line. The band mode method is more efficient, 
and is preserved in this embodiment. 

Other embodiments of the invention may use other kinds of image compression. When 
30 creating the image of a page, lossy compression should be avoided as much as possible. Because 
the amount of available memory is typically less than that required to store a full, uncompressed 
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page, some lossy compression ultimately may be required. The amount of loss, though, 
generally depends on the context of the whole page, not an individual region. 

Pages usually consist of a mixture of graphic elements, such as text, line drawings, 
white space, and scanned images. These different elements compress best with different 
5 techniques, and yield different compression results. If every region is assumed to be maximally 
complex, then highly lossy techniques would be required for the entire page, which is in 
appropriate. To allow for the degree of loss to be adaptive both to the available memory, and to 
the complexity of the whole page, an adjustable compression target is preferably used in one 
embodiment of the invention. Target compression levels may be set according to how dense the 

10 image is in a region, or could be based on the amount of contrast or color in a region. The 
compression target is the minimum acceptable compression ratio for each region when 
compressed. When beginning processing of a page, compression targets are set very low, 
allowing any region to be compressed with loss-less techniques. In such an embodiment, as the 
page is processed, the amount of RAM available may become insufficient, even with most of the 

15 page compressed. When this occurs, the compression targets are raised, and regions which are 
not compressed at least as well as the new target are recompressed with lossy techniques, to force 
them to meet the new target, until sufficient memory is recovered. RAM recovered by re- 
compressing regions is reused to image other regions of the page. If, again, all the RAM is 
consumed, the compression targets are raised higher, and the re-compression process is repeated. 

20 Compression techniques can be used to take advantage of the fact that the human visual 

system is not equally sensitive to all colors. For example, the eye is particularly sensitive to 
black, and particularly insensitive to yellow. Thus, when compression targets need to be raised, 
lossy compression techniques can used on yellow areas first, and black areas last. This adaptive 
compression techniques described above can be extended to use a different compression target 

25 for each color plate, e.g., cyan, magenta, yellow and black, depending on the kind of image data 
that is being used. The regions in which there is more yellow in the placte that contains the 
yellow sepctrum of colors are determined by examining the color plates that make up a region. 
When compression targets for a region are increased, the compression target that is raised for the 
more-yellow plate areas first, forces the yellow areas to be compressed with lossy techniques 

30 (and thus lose detail) before the black or other plates are similarly compromised. The 

compression target for cyan is raised next, followed by the compression target for magenta, and 
so on. The compression target for black is increased last. 



WO 98/13787 PCT/US97/16793 

- 13- 

The human visual system is also more sensitive to high contrast details than to low 
contrast details. Accordingly, it is more important to avoid lossy compression in regions with 
high contrast details than in regions with low contrast details. Each region may be scored 
according to an amount of important detail it contains. When compression targets are raised, 
5 they are raised first in regions having less important detail. Since the present invention does no 
have prior knowledge of the contents of the image bef ore the compression is performed, once 
one compressiqjn method is utilized, if the compression level does not meet the target 
compressioj level, another compression method can be applied instead. 

The present invention also helps reduce the amount of time used for mechanical 
10 overhead of a color laser copier when printing. This overhead involves positioning each sheet of 
paper, loading it onto the transfer drum, generating the image with typically four colors, fusing 
the document and depositing the completed document in the output tray. To improve 
throughput, these overhead times should be reduced, eliminated, or amortized over a large 
number of pages. 

1 5 For example, a large image memory is sometimes used to hold a substantial number of 

pages. Using adaptive compression and achieving high compression ratios, there is often enough 
image memory to store many full page images. By storing more data for printing, the image of a 
printer may be started and operated continuously, i.e., to the maximum number of pages the 
printer will accept in a print command. Without the compression, vastly larger quantities of 

20 expensive RAM would be required to buffer enough distinct images. Because the printer is 

processing several images, it is possible to process more images in parallel. By monitoring the 
image memory of the printer, if the memory is likely to become empty before the next image has 
been processed, the continuous print operation can be canceled. 

Another technique which may be used to optimize printer engine performance is to 

25 print black and white pages using color print cycles. Without this optimization, a document that 
is alternate color and black-only pages would incur the engine overhead on every page, typically 
running about one and a half sheets per minute. Although this typically raises the prints cost 
slightly, the speed improvement can be dramatic. Because the page description can indicate what 
kind of page is upcoming the present invention allows such an optimization to be applied. 

30 Having now described a few embodiments of the invention, it should be apparent to 

those skilled in the art that the foregoing is merely illustrative and not limiting, having been 
presented by way of example only. Numerous modifications and other embodiments are within 
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the scope of one of ordinary skill in the art and are contemplated as falling within the scope of 
the invention as defined by the appended claims and equivalent thereto. 
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CLAIMS 

1 . A computer-implemented process for representing an image, comprising the steps of: 

dividing the image into a plurality of individual regions containing image data; 
independently compressing at least one of said plurality of individual regions according 
to at least one compression method wherein said compression method used for each individual 
region is determined based upon a type of image data that exists in said individual region; and 
creating a list of index entries for said plurality of individual regions. 



2. The computer-implemented process of claim 1 , wherein: 

10 the dividing step further includes the step of: 

dividing the image into an (N-row (x) M-region) matrix, where N is the number 
of regions in each row of the image, and M is the number of rows of regions in 
the image; and 

wherein the step of creating a list of index entries for said plurality of individual regions 

1 5 further includes the step of: 

creating a linked list of region descriptors and row descriptors, wherein each 
region descriptor designates a compression method used to compress the image 
data in the region to which it corresponds and an address in storage of image 
data for the region to which it corresponds, and each region descriptor for each 

20 region in a row is linked to a next region descriptor for the row, and wherein a 

last region descriptor in a row is linked to a single row descriptor, and where the 
row descriptor is linked to a next row and contains an indication if it is a last 
row in the index. 



25 3. The computer-implemented process of claim 1 , wherein the step of independently 

compressing at least one of said plurality of individual regions compresses all of said plurality of 
individual regions. 



30 



4. The computer-implemented process of claim 1, wherein the step of independently 

compressing at least one of said plurality of individual regions compresses certain of said at least 
one of said plurality of individual regions according to lossy compression techniques. 
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5. The computer-implemented process of claim 1 , wherein the step of independently 

compressing at least one of said plurality of individual regions compresses certain of said at least 
one of said plurality of individual regions according to non-lossy compression techniques. 

5 6. The computer-implemented process of claim 1 , wherein the step of independently 

compressing at least one of said plurality of individual regions compresses certain of said at least 
one of said plurality of individual regions according to compression techniques which are not 
lossy and compresses other of said at least one of said plurality of individual regions according to 
lossy compression techniques. 

10 

7. The computer-implemented process of claim 1 , wherein the step of independently 
compressing at least one of said plurality of individual regions compresses said at least one of 
said plurality of individual regions according to a bit-mode compression format. 

8. The computer-implemented process of claim 1 , wherein said step of independently 
compressing further comprises the steps of: 

determining an adjustable compression target for at least one of said plurality of 
individual regions; 

adjusting said adjustable compression target for said at least one of said plurality of 
individual regions; 

re-compressing said at least one of said plurality of individual regions, if said adjustable 
compression target for said at least one of said plurality of individual regions is raised, so as to 
free-up storage. 

25 9. The computer-implemented process of claim 8, further comprising the steps of: 

recovering storage which was freed-up from said re-compressing step; and 
re-using said recovered storage for image representation. 

1 0. The computer-implemented process of claim 8, wherein said adjusting step further 
30 comprises adjusting said adjustable compression target based upon at least one of density, color, 
contrast, storage usage, blackness, and yellowness. 



15 



20 
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1 1 . The computer-implemented process of claim 8, wherein said adjusting step further 
comprises adjusting said adjustable compression target based upon each color plate depending on 
a kind of image data that is being represented. 

5 12. The computer-implemented process of claim 1 . wherein said step of independently 
compressing compresses said at least one of said plurality of individual regions with lossy 
compression on yellow regions first, and on black regions last. 

1 3. The computer-implemented process of claim 1 , further comprising the step of: 
10 storing at least one of said plurality of individual regions in a storage device. 

14. The computer-implemented process of claim 13, wherein the storage device is at least 
one of a frame buffer; a random access memory; a disk; a network accessible server; a network; a 
copier; a printer, a scanner. 

15 

15. The computer-implemented process of claim 1 , further comprising the step of: 
performing image processing on at least one region of said plurality of individual 

regions. 

20 1 6. A computer-implemented process for generating the representation of a document 
image, comprising the steps of: 

generating a representation of a document image, wherein the representation includes at 
least one indication of a plurality of regions into which the document image is divided, 
compressed image data for each region and an index indicating a storage location of the 
25 compressed image data for each region; 

receiving indications of operations for generating the document image; and 
for each operation, processing the representation of the document image, wherein said 
processing step further includes the steps of: 

identifying each region affected by addition of image data according to the indicated 
30 operation; 

conditionally decompressing the compressed image data of the identified region; and 
modifying the decompressed image data according to the indicated operation. 
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1 7. The computer-implemented process of claim 1 6, wherein the generating a 
representation of a document image step further comprises the steps of: 

dividing the document image into a plurality of individual regions containing image 

5 data; 

independently compressing at least one of said plurality of individual regions according 
to at least one compression method which is determined based upon a kind of data that exists in 
said at least one of said plurality of individual regions; and 

creating a linked list of index entries for said plurality of individual regions, wherein 
10 each of said index entries contains an indication of the compression method used for the 

individual region corresponding to the index entry, as well as an address of the data of the region 
corresponding to the index entry. 

18. The computer-implemented process of claim 16, wherein the step of identifying each 
1 5 region affected by addition of image data further comprises the steps of: 

receiving pixel data for image modification; 

determining a region of said plurality of individual regions which contains pixel 
locations to be modified by the received pixel data; 

and wherein the step of conditionally decompressing the compressed image data further 
20 comprises the steps of: 

determining if the region to be modified by the received pixel data is 
compressed; 

determining if sufficient free memory space is available in an image memory 
area to decompress the region to be modified; 
25 locating and compressing another region of said plurality of individual regions 

which is an uncompressed region, if sufficient free memory space is not available in an 
image memory area; 

decompressing the compressed image data of the region to be modified if the 
region is compressed; and 
30 updating the index for said plurality of individual regions. 
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19. A digital nonvolatile computer-readable data recording medium for storing a 
representation of a page of a document comprised of a plurality of regions, comprising: 

means for defining a list of region descriptions on the nonvolatile computer-readable 
data recording medium, wherein each region description includes an indication of a compression 
5 mode used to generate the compressed image data of the region, and an address indicating a 
storage location of the compressed data; and 

means for each region, for defining compressed image data of the region at the storage 
location on the nonvolatile computer-readable data recording medium. 

10 20. A computer system for representing an image, comprising: 

means for dividing the image into a plurality of individual regions containing image 

data; 

means for independently compressing at least one of said plurality of individual regions 
according to at least one compression method wherein said compression method used for each 
15 individual one of said at least one of said plurality of individual regions is determined based 
upon a type of data that exists in said individual one of said at least one of said plurality of 
individual regions; 

means for creating a list of index entries for said plurality of individual regions. 



20 21. The computer system of claim 20, wherein: 

the means for dividing steps further comprises: 

means for dividing the document into an (TM-row (x) M-region) matrix, where N 
is the number of regions in each row of the document, and M is the number of 
rows of regions in the document; and 

25 wherein the means for creating a list of index entries for said plurality of individual 

regions further comprises: 

means for creating a linked list of region descriptors and row descriptors, 
wherein each region descriptor designates a compression method used to 
compress the image data in the region it corresponds to and an address in 

30 storage of image data for the region it corresponds to, and each region descriptor 

for each region in a row is linked to a next region descriptor for the row, and 
wherein a last region descriptor in a row is linked to a single row descriptor, and 
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whcre the single row descriptor is linked to a next row and also contains an 
indication if it is a last row in the list of index entries. 

22. The computer system of claim 20, further comprising: 
5 means for receiving indications of operations for generating the document image; and 

means for processing, for each operation, the representation of the document image, 
wherein said means for processing further includes: 

means for identifying each region affected by addition of image data according 
to the indicated operation; 
10 means for conditionally decompressing the compressed image data of the 

identified region; and 

means for modifying the decompressed image data according to the indicated 
operation. 

15 23. The computer system of claim 20, wherein the means for independently compressing at 
least one of said plurality of individual regions further comprises: 

means for compressing certain of said at least one of said plurality of individual regions 
according to compression techniques which are not lossy; and 

means for compressing other of said at least one of said plurality of individual regions 
20 according to compression techniques which are lossy. 

24. The computer system of claim 20, wherein the means for independently compressing 
further comprises: 

means for determining an adjustable compression target for at least one of said plurality 
25 of individual regions; 

means for adjusting said adjustable compression target for said at least one of said 
plurality of individual regions; 

means for re-compressing said at least one of said plurality of individual regions, if said 
adjustable compression target for said at least one of said plurality of individual regions is raised, 
30 so as to free-up storage. 
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25. The computer system of claim 24, wherein said means for adjusting further comprises 
means for adjusting said adjustable compression target based upon at least one of density, color, 
contrast, storage usage, blackness, and yellowness. 

5 26. The computer system of claim 24, wherein said means for adjusting further comprises 
means for adjusting said adjustable compression target based upon each color plate depending on 
a kind of image data that is being represented. 

27. The computer system of claim 20, wherein said means for independently compressing 

l o further comprises means for compressing said at least one of said plurality of individual regions 
with lossy compression on yellow regions first, and on black regions last. 

28. The computer system of claim 20, further comprising: 

means for storing said plurality of individual regions representing an image; and 
15 means for outputting the image represented by said plurality of regions. 

29. A circuit for outputting an image stored in storage device, comprising: 

a storage device containing an image which has been divided into a plurality of regions, 
wherein each region of the image is compressed and contains a region description which includes 
20 a location of image data for a region and a form of compression used for the region, wherein the 
plurality of regions are stored as a list of rows of regions in the storage device, wherein each row 
contains as many region descriptions as there are regions across a page as well as a location in 
the storage device of a next row; 

an interconnection mechanism for connecting the storage device to an output device, 
25 wherein the output device further includes: 

a data register for storing image data from a plurality of regions; 
a command register for storing the instructions that operate on the data; 
a decipher register for reading the list of rows of regions from the 
interconnection mechanism and placing image data of a region into the data register and 
30 command data of a region into the command register; 

a means for processing data in the data register according to a command in the 
command register to produce processed data; 
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a means for outputting the processed data to an engine output interface. 

30. A method for outputting an image stored in storage device, comprising: 

(a) storing an image which has been divided into a plurality of regions in a storage 

5 device, wherein each region of the image is compressed and contains a region description which 
includes a location of image data for a region and a form of compression used for the region, 
wherein the plurality of regions are stored as a list of rows of regions in the storage device, 
wherein each row contains as many region descriptions as there are regions across a page as well 
as a location in the storage device of a next row; 

10 (b) connecting the storage device to an output device; 

(c) reading regions from the list of rows of regions from the storage device; 

(d) storing image data from the regions read; 

(e) storing the instructions that operate on the image data; 

(f) processing the stored image data according to the stored instructions which 
] 5 corresponds to the image data, to produce processed data; 

(g) outputting the processed data. 



31 . The method of claim 30, wherein the reading step (d) includes a separate step of: 
20 (c-i) reading enough regions from the list of rows of regions to be equal to one scanlinc; 

and wherein the step of processing stored image data includes the steps of: 

(f-i) generating pixels from stored image data according to the instruction for 
that image data; and 

(f-ii) selecting a next region from regions read from the list of rows of regions to 
25 generate pixels for; 

(f-iii) repeating said generating and selecting steps until an end of the scanline is 
reached; 

(f-iv) determining if a current region is a location in the row of a next row, and 
if so then returning to step (c), and if not, then returning to step (c-i). 
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